Generalization of the maximum entropy principle for curved statistical manifolds

نویسندگان

چکیده

The maximum entropy principle (MEP) is one of the most prominent methods to investigate and model complex systems. Despite its popularity, standard form MEP can only generate Boltzmann-Gibbs distributions, which are ill-suited for many scenarios interest. As a principled approach extend reach MEP, this paper revisits foundations in information geometry shows how curved statistical manifolds naturally leads generalization based on R\'enyi entropy. By establishing bridge between non-Euclidean our proposal sets solid foundation numerous applications entropy, enables range novel systems analysis.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Latent Maximum Entropy Principle for Statistical Language Modeling

In this paper, w dcscrihe a unified probabilistic framework for statistical lmiguage modeling, latent mmmum mtmpy Wnciple. The salient feature of this approach is that the hidden causal hierarchical dependency structure can be enc d e d into thpsiatwtical model in a principled way hy mixturts of expoocntial families with a rirh expressive power. We first show tlie problem lormulatiun, whition, ...

متن کامل

The Relevance of Maximum Entropy Production Principle and Maximum Information Entropy Principle in Biology

We start this talk posing the question, is there any physical principle that can serve as a selection principle in biology too? One of the first undertakings in this direction, conducted by Prigogine and Wiame [1] noticed correctly that biological processes are irreversible and as such should be described within irreversible thermodynamics. Since irreversible processes are characterized by entr...

متن کامل

Maximum Entropy Principle for Quadratic Entropy of Uncertain Variables

In uncertainty theory, quadratic entropy is a type of entropy that provide a quantitative measurement of the uncertainty of uncertain variables. This paper presents the maximum entropy principle for quadratic entropy of uncertain variables, that is, out of all the uncertainty distributions satisfying given constraints, choose the maximum quadratic entropy one.

متن کامل

Maximum Entropy Principle for Uncertain Variables

The concept of uncertain entropy is used to provide a quantitative measurement of the uncertainty associated with uncertain variables. After introducing the definition, this paper gives some examples of entropy of uncertain variables. Furthermore this paper proposes the maximum entropy principle for uncertain variables, that is, out of all the uncertainty distributions satisfying given constrai...

متن کامل

Notions of the ergodic hierarchy for curved statistical manifolds

We present an extension of the ergodic, mixing, and Bernoulli levels of the ergodic hierarchy for statistical models on curved manifolds, making use of elements of the information geometry. This extension focuses on the notion of statistical independence between the microscopical variables of the system. Moreover, we establish an intimately relationship between statistical models and family of ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Physical review research

سال: 2021

ISSN: ['2643-1564']

DOI: https://doi.org/10.1103/physrevresearch.3.033216